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1.  INTRODUCTION 


Many  time  series  encountered  in  engineering  applications  are 
strongly  periodic  —  for  example,  outdoor  temperature,  electrical  con¬ 
sumption,  the  roughness  of  machined  surfaces,  and  machine  tool  chatter 
vibration.  This  periodic  behavior  is  caused  by  the  dynamics  of  the 
underlying  physical  system.  Engineers  are  interested  in  analyzing  these 
time  series  in  order  to  characterize,  forecast,  and  control  the  underly¬ 
ing  system.  There  are  several  different  approaches  currently  being  used 
to  model  this  type  of  time  series.  However,  there  is  little  agreement 
in  the  time  series  literature  on  the  appropriateness  of  alternative 
models. 

The  first  approach,  developed  by  Box  and  Jenkins  (1970),  advocates 
the  use  of  a  seasonal  difference  operator  and  seasonal  autoregressive- 
moving  average  parameters.  These  are  then  combined  with  non-seasonal 
differencing  and  non-seasonal  autoregressive-moving  average  parameters, 
as  appropriate,  resulting  in  a  multiplicative  autoregressive- 
integrated-movlng  average  (ARIMA)  model.  This  approach  was  used  by  Jen¬ 
kins  (1979)  to  model  outdoor  temperature  and  electrical  consumption,  by 
Kline  (1979)  to  model  outdoor  temperature  and  the  roughness  of  machined 
surfaces,  and  by  DeVor  and  Wu  (1971)  to  model  surface  roughness. 

The  second  approach,  known  as  DDS  —  developed  by  Pandit  and  Wu, 
Pandit  (1973),  Wu  (1977),  and  Pandit  and  Wu  (1982)  —  advocates  the  use 
of  models  of  the  form  ARMA(n,n-l).  This  approach  was  used  by  Kline 


(1979)  to  model  outdoor  temperature  and  surface  roughness,  by  O'Connor 
and  Kapoor  (1982)  to  model  electrical  consumption,  and  by  DeVries  (1979) 
to  model  tool  chatter  vibration  in  a  single  point  turning  operation. 

This  approach  generally  resulted  in  the  identification  of  high  order 
ARMA  models.  For  example,  DeVries  found  an  ARMA(10,9)  for  a  chatter 
vibration  model,  and  Kline  found  an  ARMA(8,6)  was  required  to  adequately 
model  temperature. 

The  third  approach  consists  of  modeling  periodic  time  series  with  a 
combined  deterministic  plus  stochastic  model.  Typically,  the  deter¬ 
ministic  portion  is  modeled  by  a  sum  of  relatively  few  sinusoids  and  the 
stochastic  portion  by  a  relatively  low  order  ARMA  model.  This  approach 
essentially  extends  the  classical  curve  fitting  approach  which  assumes 
that  independently  and  identically  distributed  errors  (white  noise)  are 
superposltioned  on  deterministic  functions.  Anderson  (1971)  discusses 
the  problems  of  statistical  Inference  both  under  the  classical  error 
assumptions  and  when  the  random  element  satisfies  a  stochastic  differ¬ 
ence  equation.  This  approach  was  used  by  Kline  (1979)  to  model  tempera¬ 
ture  and  surface  roughness;  by  Hittle  (1981),  Hittle  and  Pedersen  (1981) 
to  model  temperature;  and  by  O'Connor  and  Kapoor  to  model  electrical 
consumption. 

Kline  studied  the  relative  merit,  based  on  the  one-step  and  Jl-step 
ahead  forecast  error,  of  Box-Jenkins,  DDS,  and  deterministic  plus  sto¬ 
chastic  models  for  several  periodic  time  series.  In  general,  he  found 
that  deterministic  plus  stochastic  models  provided  better  forecasts  than 
either  the  Box-Jenkins  or  DDS  models.  O'Connor  and  Kapoor  found  that  a 
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deterministic  plus  stochastic  model  provided  be' ter  forecasts  than  the 
models  identified  by  DDS  for  electrical  consumption  for  all  forecasts 
from  one  to  24  hours  ahead.  A  similar  result  was  reported  by  Pandit  and 
Wu  in  modeling  the  classical  airline  data  originally  presented  by  Box 
and  Jenkins.  Box  and  Jenkins  concluded  that  an  ARIMA  model  was  adequate 
for  forecasting  the  airline  data. 

DeVries  used  the  DDS  approach  to  model  tool  chatter  in  order  to 
characterize  the  vibration  dynamics  for  control  purposes.  He  speculates 
that  the  relatively  high  order  ARMA  models  identified  by  DDS  may  be  able 
to  be  simplified  via  pole-zero  cancellation.  DeVries  further  notes  that 
this  would  be  particularly  attractive,  for  simplified  on-line  control  of 
turning  operations,  if  an  AR(2)  were  found  to  be  sufficient. 

Hittle  and  Pedersen  developed  ARMA  models  via  the  DDS  approach  and 
deterministic  plus  stochastic  models  to  forecast  outdoor  temperature  for 
use  in  the  calculation  of  heat  conduction  through  multi-layered  building 
walls  and  floors.  They  note  that  this  calculation  is  simplified  if  the 
outside  surface  temperature  can  be  treated  as  the  sum  of  pure  sinusoids. 
Hittle  and  Pedersen  conclude  that  both  Fourier  analysis  and  the  DDS 
modeling  procedure  allow  identification  of  periodic  behavior.  However, 
they  further  conclude,  adequate  ARMA  models  do  not  provide  good  esti¬ 
mates  of  the  amplitude  of  the  principal  sinusoidal  behavior. 


The  confusion  and  ambiguity  in  today's  time  series  literature 
regarding  the  appropriateness  of  alternative  models  makes  it  difficult 
to  select  a  valid  modeling  approach.  Criteria  are  needed  for  selecting 
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appropriate  modeling  approaches  for  this  type  of  strongly  periodic  time 
series.  This  research  represents  a  first  step  towards  establishing 
selection  criteria.  A  fundamental  understanding  of  the  similarities  and 
differences  among  alternative  models  will  be  gained  by  understanding  the 
manner  in  which  alternative  models  account  for  the  variance  in  periodic 
time  series.  In  particular,  the  objective  of  this  thesis  is  to  identify 
mathematically  the  spectral  equivalency,  when  it  exists,  between  a 
deterministic  and  a  stochastic  representation  of  a  periodic  component  in 
a  time  series.  Since  the  spectrum  represents  the  frequency  decomposi¬ 
tion  of  the  variance  of  the  time  series,  this  provides  a  criterion  for 
selecting  an  appropriate  model. 

In  order  to  establish  this  spectral  equivalency,  the  spectrum  for  a 
discrete  deterministic  time  series,  consisting  of  a  sinusoid  plus  white 
noise,  is  derived  in  Chapter  2.  The  spectrum  for  a  second  order 
Autoregressive-second  order  Moving  Average,  ARMA(2,2),  stochastic  model 
is  derived  in  Chapter  3.  Equivalency  between  deterministic  and  stochas¬ 
tic  models  is  defined  in  Chapter  4  based  on  the  frequency  decomposition 
of  the  variance  of  the  time  series.  A  procedure  for  identifying  an 
equivalent  stochastic  model  for  a  given  deterministic  model  is  also 
presented.  The  identification  procedure  is  illustrated  with  a  numerical 
example  in  Chapter  5. 


I 


2.  DETERMINISTIC  SPECTRUM 


Spectrum  of  a  Sinusoid 

Consider  a  periodic  time  series  consists  of  a  single 

sinusoid  plus  white  noise. 

*t  =  dt  +  at  ^Eq*  2_1^ 

where 


d  =  A  cos  (tot  +  to  ) 
t  o 


and 


at  is  an  independently  and  identically  distributed  random 

2 

variable  with  mean  0  and  variance  oa;  i.e., 

a  is  iid  (0,a2) 
t  a 

and 

a^  and  are  independent. 

The  spectral  density  function,  or  more  commonly  the  spectrum  of 
{xt},  will  be  denoted  by  fx(0)  and  is  defined  by  the  discrete  Fourier 
transform,  Jenkins  &  Watts  (1968): 


I 
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fX(6)  =  7TN  I  A  Xt 


let 


C=1 


0  <  0  <  v 


(Eq.  2-2) 


Substituting  =  d^  +  at  yie 


Ids 


£x<91  -«T 


r  ,  i6t  r 

2.  dt  e  +  l  at 

t=i  t=i 


i0t 


(Eq.  2-3) 


Since  the  complex  absolute  value  squared  of  a  complex  number  Is  the 
product  of  the  complex  number  and  its  conjugate,  Churchill  (1974), 
expansion  yields 


c  1  ,v  ,  i0tr ,  -i0t  .  i0t  _  -i0t 

f  =  (E  d^e  e  +  Ed  e  Ea  e 

x  ttN  t  t  t  t 


i0t  v,  -i0t  „  i0t  v  -i0t. 

+  Eate  Edte  +  Eate  Eate  )  (Eq.  2-4) 
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But 


r  .let  r 

l  d®  L  \ 

t-1  k»l 


-10k  r  r  .  i0(t-k) 

e  -EE  d  a  e 

tk  U 


?  «  dt  Vi>  • 
S,  t 


i0i 


where  £  -  t-k 


=  0 


(Eq.  2-5) 


Since  ff(d  a  )  -  £(d£)  •  E(a^)  -  0  which  implies  Edtat  -  0 


Similarly 


„  i0t  _  .  -i0t  n 
Eafce  Edte  =  0 


(Eq.  2-6) 


Hence  Eq.  2-4  can  be  written  as 


fx<9>  "  5 


?  d  ei0t 

2  +± 

r  i0t 

L  dte 
t-1 

ttN 

L  ate 
t-1 

(Eq.  2-7) 


That  is,  the  spectrum  of  the  sum  is  the  sum  of  the  spectra  when  series 
are  independent. 

The  spectrum  of  {dt }  can  be  shown  (Appendix  A)  to  be 
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fd(0) 


A 

4ttN 


2  f  sin 


2  N (art-6) 


sm 


N  (art-0) 


sm 


N(a)-9) 


— - — — — +  2  cos[  (N+l)art-2a)  ] 
.  2  art-0  o 


art-0 


sm 


sin 


a>-0 


sin 


2  N(a>-0)  _ 


sin 


2  a)-e 


(Eq.  2-8) 


Since  the  spectrum  for  a  finite  discrete  series  is  only  defined  at 
discrete  points,  it  is  understood  that  9  »  .—1  j  =  0,1,2,...,^. 

The  spectrum  can  be  evaluated  at  6  *  w  by  applying  n'Hopital's  rule 
to  evaluate  the  Indeterminate  factor  as  follows: 


lim 

Q-ho 


sin 


N  (q)-0 ) 


sm 


(oj-0) 


lim 

0-HO 


=  N 


N 

N(S=®5 


sin 


o>-0 


q)-0 
"  ? 


(Eq.  2-9) 


Therefore,  from  Eq.  2-8  and  Eq.  2-9,  we  get 


4ttN 


sin  No)  „  ,  0  ,  Ns  in  No) 

- -r—  +  2  cos[  (N+l)w  +  2a)  ]  — ; - + 

.  .  o  sin  at 

L  sm  to 


■1 


(Eq.  2-10) 


If  N  Is  chosen  such  that  it  is  an  integer  multiple  of  the  periodicity 


2  TT  |c 

i.e.,  if  w  =  -  where  k  is  a  non-zero  integer,  then  sin  Nw  -  0  and 

N 

Eq.  2-10  reduces  to 


p  /  \  A2  N 
fd(w)  2  2tt 


(Eq.  2-11) 


2ni  2TTk 

For  0  ^  to  i.e.  0  ,  to  =  ~  and  j  ^  k 

N  N 


sin 


N(uH-e) 

2 


sin(k+j)tr  =  0 


(Eq.  2-12) 


and 


.  N  (oi-0)  ,  „ 

sin  - j—  =  sin(k-j  )n  =  0 

Therefore,  in  this  case  Eq.  2-8  reduces  to 

f  ,(9)  =0  0  *  to 

a 


Spectrum  of  White  Noise 


(Eq.  2-13) 


(Eq.  2-14) 


The  spectrum  of  {at}  can  be  shown  (Appendix  B)  to  be 
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f  (6)  =  V 
a  tt 


(Eq.  2-15) 


Spectrum  of  a  Deterministic  Model 


Thus  the  spectrum  of  {xt},  denoted  by  fx(6),  where 


,2-rrk 


,  H  IS.  ,  \  , 

cos(—  t  +  (a)  )  +  a.  is 
N  o  t 


(Eq.  2-16) 


f  (^) 
xv  N  ’ 


„  a 

£L_  .  —  +  —  j 

2  2tt  tt 


a 

ir 


j  +  k 


(Eq.  2-17) 


for  .1  =0,  1, 


N 

•  •  »  2 


This  spectrum  is  shown  graphically  in  Figure  2-1. 

The  spectrum  represents  the  frequency  decomposition  of  the  variance 
of  {xt}.  This  can  be  seen  by  integrating  the  spectrum  via  the  rectangu¬ 
lar  rule  to  show  that  the  area  is  equal  to  the  variance  of  {xt}. 
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Var(xt)  =  ~2 


_N_ 

2tt 


A  2 

=  -r-  +  CT 
^  a 


2tt  +  _  2tt 

N  tt  ’  IT 


N 

2 


(Eq.  2-18) 


That  Is,  the  variance  of  xt  is  the  sum  of  the  variance  of  dt  and  at 
since  dt  and  at  are  independent. 

2 

°a 

Note  that  Eq .  2-17  can  be  normalized  by  dividing  by —  (iff 

Tt 


TT 

~2 

a 

a 


f  (-J-) 

x  N 


1 


j  =  k 

j  *  k 


for  j  =  0,  1, 


N 

2 


(Eq.  2-19) 


In  summary,  we  have  shown  in  this  chapter  that  the  spectrum  for  a 
sinusoid  plus  white  noise  is  equal  to  the  sum  of  the  spectrum  for  a 
sinusoid  and  the  spectrum  for  white  noise.  The  spectrum  for  a  discrete 
sinusoid  plus  white  noise  will  be  used  in  Chapter  4  to  establish 
equivalency  between  deterministic  and  stochastic  models. 
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STOCHASTIC  SPECTRUM 


Stochastic  Model 


We  now  consider  stochastic  models  of  the  form 


0(B) 

yt  "  W  3t  =  *(B)at 


(Eq.  3-1) 


where  e(B)  and  41(B)  represent  polynomials  in  B,  the  back  shift  operator, 

2 

which  is  defined  such  that  Bxt  *  xt_j,  and  at  is  an  idd  (0,0^)  random 

variable.  Specifically,  we  will  consider  ARMA(2,2)  models  since  two 
degrees  of  freedom  are  required  to  allow  the  roots  of  the  polynomial 
equations  associated  with  q(B)  and  4>(B)  to  be  complex. 

This  model  is  written  mathematically  as 


(l-^B-^B  ) 


77-  a 
2,  t 


(Eq.  3-2) 


which  means 


yt  =  Vt-l  +  Vt-2  +  nt  '  Vr-I  "  °2at-2 


(Eq.  3-3) 
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Spectrum  of  a  Stochastic  Model 

The  spectrum,  denoted  by  f y(0 ) ,  of  the  output,  yt,  of  a  linear 
filter,  iKB),  is  related  to  the  spectrum,  fa(e),  of  the  input,  at,  as 
follows,  Anderson  (1971): 

fy(6)  =  |iKe“16)|2  fa(0)  (Eq.  3-4) 


Since  the  input,  at,  is  white  noise,  fa(0) 


2 

— — .  Thus , 

IT 


f  (9) 

y 


2 

0 

TT 


<P(e  L0) 


2 


(Eq.  3-5) 


That  is,  the  spectrum  of  (yt)  is  equal  to  the  variance  of  at 
divided  by  it  times  the  complex  absolute  value  squared  of  the  transfer 
function  iji(B)  evaluated  at  B  ■  e-i9. 


Now, 


♦  (B) 


9(B) 
♦  (B) 


(l-OjB-^B2) 

(i-4>1b-4>2b2) 


(Eq.  3-6) 


can  be  written  as 


(1-vB) (1-vB) 
^(B)  (I-AB) ( 1 -Tb) 


(Eq.  3-7) 
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where  It  Is  assumed  that  the  roots  of  the  associated  polynomial  equa¬ 
tions  of  6(B)  and  $(B)  are  the  coaplex  conjugates  v,  ~  and  A»  A,  respec¬ 
tively.  The  coaplex  nuabers  v  and  ~  will  be  called  the  zeros,  and  a  and 
A  will  be  called  the  poles  of  the  ABMA(2,2)  model.  The  zeros  and  poles 
are  assuaed  to  be  coaplex  conjugate  pairs  in  order  to  allow  thea  to  be 
near  eia),  which  will  be  shown  in  Chapter  4  to  be  necessary  for  spectral 
equivalence . 


Therefore, 


|ip(e~10) 


2 


a-ve~ie)(l-ve~18)  | 

|  (1-Xe"i0)(l-Ae"10)|2 


(Eq.  3-8) 


If  we  multiply  each  factor  in  the  numerator  and  denominator  of 
Eq.  3-8  by  e^Q  we  get 


,,16  w  18 
1  (e  -  v)  (e 

i,  10  .  w  16 

|(e  -  A)(e 


(Eq.  3-9) 


which  can  be  rewritten,  Churchill  (1974),  as 


Figure  3-1  graphically  illustrates  Eq.  3-10  in  the  complex  plane.  Since 
je19-v|  la  the  distance  between  e*®  and  v,  and  |e*9-A|  is  the  distance 
between  eie  and  A,  the  first  term  is  equal  to  the  ratio  of  these  two 
lengths  squared.  Similarly,  |e*®-v|  and  |e*®-\  |  represent  the  distance 
between  e*9  and  ~  and  T,  respectively.  Hence  the  second  term  is  equal 
to  the  ratio  of  these  two  lengths  squared. 


If  we  define  v  and  v  such  that  in  polar  form 

icr  —  -ia 

v  =  se  ,  v  =  se 


(Eq.  3-11) 


and  A  and  A  such  that 


re 


ip 


re 


-ip 


(Eq.  3-12) 


then  |<Ke  i0)|2,  Eq. 


3-8,  can  also  be  represented  conveniently  as 


i  ,  -10* 

U(e  ) 


2 


l(l-s«-1(6-g>)q-se-1(eW))|2 
|  (l-re“i(0_p))(l-re"i(0+p))|2 


(l-2s  cos(9-a)+s2)  .  (l-2s  cos (6+o)+s2) 
(l-2r  cos(9-p)+r2)  (l-2r  cos (0-H3)+r2) 


(Eq.  3-13) 


The  two  factors  in  Eq.  3-10  and  Eq.  3-13  can  be  seen  to  be  equal  by 


considering  |e*®-v|  as  shown  in  Figure  3-2.  Application  of  the  Cosine 
formula  for  two  sides  and  the  included  angle  yields  immediately: 


1  REAL 


terpretation  of  |tj>  (e-*9)  p 
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i  B  2  2 

|e  -v|  =  1  +  s  -  2s  cos(0-o)  (Eq.  3-14) 

Similar  application  of  the  Cosine  formula  to  the  three  other  dis¬ 
tances  completes  the  demonstration. 

In  this  chapter  we  have  defined  the  spectrum  and  developed  a  graph¬ 
ical  Interpretation  of  the  poles  and  zeros  for  a  stochastic  model.  This 
interpretation  will  be  used  in  Chapter  4  to  identify  equivalent  deter¬ 
ministic  and  stochastic  models. 


4.  EQUIVALENT  DETERMINISTIC  AND  STOCHASTIC  MODELS 


Definition  of  Equivalence 

Equivalence  between  the  deterministic  and  stochastic  models  will  be 
established  via  their  spectral  representations.  The  spectrum  of  the 
stochastic  model  will  be  equated  to  the  spectrum  of  the  deterministic 
model  in  the  sense  that  they  both  represent  the  same  frequency  decompo¬ 
sition  of  variance.  Since  the  area  under  the  spectrum  represents  vari¬ 
ance,  equivalence  is  established  by  equating  the  area  under  each  spec¬ 
trum. 


The  area  under  the  deterministic  spectrum  is  found  via  the  rec¬ 
tangular  rule  for  integration.  This  is  due  to  the  nature  of  the 
discrete  Fourier  transform  that  was  used  to  derive  the  deterministic 
spectrum.  Brigham  (1974)  presents  a  nice  graphical  development  of  the 
discrete  Fourier  transform  for  sampled  data.  The  rectangular  area 
around  any  specific  discrete  frequency,  say  e*»  represents  the  variance 

of  that  is  contained  in  the  frequency  interval  0*  -  —  to  e*  +  i. 
c  N  N 

That  is, 

Var(xt)|  ^  fx(0*)  (Eq.  4-1) 

0*±N 

It  is  important  to  note,  according  to  sampling  theory,  Kuo  (1977),  that 
a  discrete  time  series  can  only  contain  information  about  the  total 

N  2 

variance  in  each  of  the  _  frequency  intervals  of  length  — .  Thus  the 

2  N 
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spectrum  of  the  discrete  deterministic  model  represents  the  total  vari¬ 
ance  in  each  Interval  but  contains  no  information  on  how  the  variance  is 
distributed  within  each  frequency  interval. 


The  spectrum  for  a  stochastic  model,  however,  is  continuous. 
Therefore,  the  value  of  the  spectrum,  fy(0*),  at  the  frequency  0* 
represents  the  variance  of  y  at  0*.  The  total  variance  in  any  interval 
is  found  by  integrating  fy(0)  over  the  interval.  Thus, 


Var(vt)!0*  +£ 


f  (6)dfl 

y 


(Eq.  4-2) 


In  order  to  directly  compare  the  spectral  representation  of  a  sto¬ 
chastic  model  to  the  discrete  spectrum  of  a  deterministic  model,  we  will 

* 

define  the  equivalent  discrete  stochastic  spectrum,  denoted  by  fy(0),  as 
follows : 


f*(0) 

y 


rQ  +  L 
N 


0  - 


TT 

N 


f  (0)d0 
v 


(Eq.  4-3) 


where  it  is  understood  that  6 


2nj 

N 


j-0,1,2, 


•  •  • 


N 

T 


In  summary,  the  deterministic  and  stochastic  models  are  equivalent 
when  the  frequency  decomposition  of  the  variance  is  the  same  for  both 

models.  That  is,  when  ^  fx(  0)  ■  f^(  0)  0  ■  j  ■  0,1,2..., 
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Care  must  be  taken  for  non-normal  processes  since  the  uniqueness 
implied  above  is  only  guaranteed  for  second  order  stationary  normal 
processes,  Jenkins  and  Watts  (1968)  and  Chattfield  (1975). 

Procedure  for  Identifying  Equivalent  Models 

Model  equivalence  requires  interval  by  interval  equality  for  each 

of  the  —  intervals;  therefore,  model  equivalence  also  Implies  equality 
2 

of  the  total  variance  over  the  entire  frequency  range  from  0  to  n.  The 
equality  of  the  total  variance  is  a  necessary,  but  not  sufficient,  con¬ 
dition  for  model  equivalence.  However,  it  can  be  used  as  a  gross  check 
on  model  equivalency. 

Two  concepts  will  now  be  introduced  to  provide  a  practical  pro¬ 
cedure  for  identifying  an  equivalent  stochastic  model  for  a  given  deter¬ 
ministic  model. 

The  first  concept  relies  on  the  geometric  interpretation  of  the 
stochastic  spectrum  introduced  in  Chapter  3  and  the  normalized  deter¬ 
ministic  spectrum  from  Chapter  2. 

A  pair  of  complex  conjugate  poles  (  A,  A)  and  zeros  (  v,  "v)  are  shown 
in  the  unit  circle  on  the  complex  plane  in  Figure  4-1.  A  graphical 
interpretation  of  fy(9)  which  was  demonstrated  in  Chapter  3  (Eq.  3-5  and 
3-10)  to  be  a  function  of 
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i^-V-  v 


[ifeff  ■  [ 


|e1B-  jj' 

|e10-  X| 


(Eq.  4-4) 


is  shown  for  8  ■  9*  and  6  *■  oj. 

It  can  be  seen  if  X  and  v  are  close  to  the  boundary  of  the  unit 
circle,  and  near  e^,  with  v  farther  from  than  A  is  from  elu,  that 
when  0  »  8* 


i  10' 

e  -  v  | 


I  19 

e  -  X 


(Eq.  4-5) 


and 


,  ie*  ,  |  ie"  T-, 
|e  -  V I  -  I e  -  X| 


(Eq.  4-6) 


hence,  from  Eqs.  4-4,  4-5,  and  4-6 


|0(e10  )|2  *  I2  •  l2  '  1 


(Eq.  4-7) 


When  9  =  w 


|ei(i>-  v|  >  >  |e*'W  -  A 


(Eq.  4-8) 


and 


iu  — i  .  i  iu  t 


e  -  v  -  e 


-  x| 


(Eq.  4-9) 


hence,  from  Eqs.  4-4,  4-8,  and  4-9 
|*(e-1“,|2  -I  I'1" 


V“  -  vii2 .  .  n.-  -  vf 

j.lu-  »ij  Li.*-., i 


(Eq.  4-10) 
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Thus,  under  these  assumptions,  the  stochastic  spectrum 


f  (6)  =  -f 
y  11 


i t 

i}'(e  ) 


(Eq.  4-11) 


is  approximately  equal  to  —  for  0  ^  w  and  approximately  equal  to 


2 

o  Iei0_  v  12 

JL  i 1 - 1 —  for  0  -  (o. 


11  |ele-x(2 


The  most  critical  case  in  the  above  approximation  occurs  when  6*  is 
near  cj.  We  want  |eluJ-v|  much  larger  than  |eiu-x|  and,  simultaneously, 
|e*9*  —  v |  approximately  equal  to  |e*-e*  -X|.  This  means  that  |e^- ^  —  v | 
must  be  much  smaller  than  |e*6*  -  e*w  |  for  0*  near  w.  Since 

*  n  f  ID"  2- 

f  <tt  -  li)  -  N  f  (0)d0  (Eq.  4-12) 

y  n  J  u-  h  y 

N 

and 


*  2it 

fv  (<-  +  il) 

y  n 


u>  + 

N  fy(0)d0 
0J+  JL 

N 


(Eq.  4-13) 


the  most  critical  value  for  0*  is  when  0*  ■  w+  — .  Hence,  we  want 

~  N 


i  iw  i  I  i(u)±iJN)  iu>i  «  ,  JL 

|e  —  v  J  <  <  |  e  -el  *■  sln  2N 


(Eq.  4-14) 
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The  spectrum  of  a  deterministic  sinusoid  plus  white  noise,  i.e., 


x  =  A  cos(ojt  +  u)  )  +  a 
t  o'  t 


(Eq.  4-15) 


where 


a  is  iid(0,<J  ) 
r  a 


a^  and  dt  are  independent 


was  shown  in  Chapter  2,  Eq.  2-17,  to  be 


2  N  a2 

A_  .  JL  + 

2  2tt  tt 


0  =  u) 


f  (0)  = 
x 


(Eq.  4-16) 


0^0) 


Figure  4-1  has  shown  that  for  suitably  chosen  A  and  v  that 


fy(0)  - 


2  - 

fa  | 

"  LI 


iw  i 

e  -  v| 

iu)  ,  | 
e  -  A 


0  =  0) 


(Eq.  4-17) 


0^0) 


Thus  the  two  spectra  represent  the  same  general  decomposition  of  vari- 


i 
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The  second  concept  for  identifying  the  specific  form  of  the  sto¬ 


chastic  spectrum  takes  advantage  of  the  general  form  of  fy(6)  and  the 
equality  of  total  variance  over  the  entire  spectra. 


If  the  total  area  under  each  spectrum  is  equal  and  the  spectra  are 
equal  everywhere  except  for  8  ■  to,  then  the  area  in  the  Interval  around 
a)  must  be  equal.  That  is,  if 


’ 


2 


IT 

‘ 

f  (0)  d0  (Eq.  4-18) 

0 


TT 

|  fy(0)  d0 
0 


(Eq.  4-19) 


and 


f  (0)  =  f  (0)  0  *  w 

x  y 


(Eq.  4-20) 


then 


e  =  u  +  -s. 

r  n 


f  (0)  d0 

y 


(Eq.  4-21) 
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The  identification  procedure,  therefore,  consists  of,  1)  choosing  X 
and  v  such  that  f^(e)  has  the  general  form  of  Eq.  4-17  with 

1Tfy(0)d0  *  —  +  and,  2)  comparing  f  (e)  to  f  (6)  for  8  = 

Q  J  2  a  y  Nx  N 

j  “  0,1,2,  •••,  — • 

Before  discussing  specific  procedures  for  finding  X  and  v  a  method 

fir 

for  evaluating  the  fy(0)d0  utilizing  Green’s  function  will  be 

Jo 

presented.  This  will  eliminate  the  need  to  do  some  integrations  in  the 
identification  procedure. 


Green's  function,  also  called  ^-weights  by  Box-Jenkins  (1970), 
represents  an  orthogonal  decomposition  of  a  time  series  by  expressing 
the  time  series  as  a  linear  combination  of  independent  random  variables. 
That  is,  for 


yt 


0(11  a 

♦  (B)  t 


=  ♦(B)ac 


(Eq.  4-22) 


Green's  function,  denoted  by  Gj,  is  defined  such  that 


yt  = 


t-j 


(Eq.  4-23) 


Since  the  at's  are  mutually  independent,  identically  distributed 
random  variables,  Eq .  4-23  implies,  Hogg  &  Craig  (1978): 


I 

1 

I 

i 
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where  r  »  | X | 

P  -  Arg  (X) 
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The  spectral  equivalence  of  deterministic  and  stochastic  models  has 
been  developed  in  this  chapter.  A  procedure  to  identify  an  equivalent 
stochastic  model  for  a  given  deterministic  model  also  has  been 
presented.  This  procedure  utilizes  the  graphical  interpretation  of  the 
stochastic  spectrum  presented  in  Chapter  3  and  the  analytic  expression 


for  l 

j-0  J 


derived  in  Appendix  C. 


The  identification  procedure  will  be 


illustrated  in  the  next  chapter 
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5.  EXAMPLE  OF  THE  IDENTIFICATION  OF  EQUIVALENT  MODELS 


General  Discussion 

The  following  example  Illustrates  the  specifics  of  the  procedure 
for  identifying  an  equivalent  stochastic  model  for  a  given  deterministic 
model.  The  deterministic  model  is  "given”  in  the  sense  that  Fourier 
analysis  of  {xt}  has  been  used  to  identify  the  deterministic  model.  The 
converse  problem  —  given  a  stochastic  model:  find  the  equivalent 
deterministic  model  —  is  solved  by  a  straightforward  (actually  simpler) 
application  of  the  principles  illustrated  in  this  example. 

Given 


dt  +  at 


t  =  1,  2 . N  (Eq.  5-1) 


where 


=  A  cos(u)t  +  w  ) 
t  o 

2 

a  is  an  iid  (0,0  )  random  variable 
t  a 

and 

d^  and  at  are  independent 

Find 

(1-91B-92B2) 

y - Y  at 

(i-4>1b-<j>2b  )  c 


(Eq.  5-2) 


such  that  { x^ } ,  {yt}  have  the  same  second  order  properties 
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While  the  choice  of  X  and  v  is  restricted  to  be  near  ei(u  and  inside 
the  unit  circle,  this  still  leaves  an  infinity  from  which  to  choose. 
However,  the  "best"  placement  for  both  X  and  v  is  such  that  their  argu¬ 
ments  are  both  equal  to  u. 

Define  X  and  v  such  that  in  polar  form 

X  =  r  (Eq.  5-3) 

v  =  s  e10  (Eq.  5-4) 

and  let 

p  =  a  -  oi  (Eq.  5-5) 


This  placement  is  "best"  in  the  sense  that  the  spectrum  evaluated 
at  the  discrete  frequency  before  and  after  u>  will  be  approximately 
equal.  That  is, 


f*(w  - 

y  N 


fy*(“  +  T> 


(Eq.  5-6) 


This  means  that  both  of  these  values  can  simultaneously  be  made  arbl- 
2o2 

trarily  close  to  _ Reca  .1,  Eq.  4-17,  that 


f 

y 


iw  ,1 


e  -v 


2 


(Eq.  5-7) 


A 
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Thus,  £  (to)  is  dominated  by  the  ratio  of  the  distance  between  e*u  and  v 

y 

and  the  distance  between  ela>  and  X.  This  is  also  true  for  the  spectrum 
near  o>.  Hence, 


f*(U) 

y 


*  2tTv  ~  2a 

:*(w  +  ~ 

y  N  N 


(Eq.  5-8) 


requires  that 


|ei(q,±K/H)_  v|  «  x 
|  gi  (w±n/Il)_  X| 


(Eq.  5-9) 


This  condition  will  be  satisfied  when 


i  k  I  ,  i  itu  ,  i  „  „  |  i(ui±Tr/N)  iwi  „  .  it 

e  *  vl  and  le  -  M  <  <  le  -e  j  -  2  sin  —  (Eq  5_1Q) 


The  above  condition  is  satisfied  when  both  X  and  v  are  much  closer 

to  e*-10  than  to  e*(u  i  When  p  -  a  »  to,  both  X  and  v  are  equally 

far  from  e*(w  “  and  e1^  +  '"/N) ,  respectively,  and  the  ratio  of  the 

distances  can  be  made  arbitrarily  close  to  one.  This  idea  is  illus¬ 
trated  in  Figure  5-1.  The  distance  between  e*“  and  e*^  i  has  been 
greatly  exaggerated  to  illustrate  the  concept  of  relative 
"nearness" /"farness. "  As  can  be  seen  in  Figure  5-1, 
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I  i  (u)±  ir/N)  i 

h. _ i-1—  7  y  1  ~  l 

|e±(tu±ir/N>  _A| 


even  though 


(Eq.  5-11) 


ico 
e _ 

I  id) 

I e 


Al 


-L-i_g  >  >  i 

1  -  r 


(Eq.  5-12) 


Thus,  placement  of  X  and  v  on  the  same  radian  as  u  with  r  >  s 
results  In  a  stochastic  spectrum  of  the  same  general  form  as  the  deter¬ 
ministic  spectrum. 


To  find  specific  values  for  X  and  v,  given  p  m  a  m  ui,  we  will 
assign  r  arbitrarily  close  to  one  and  calculate  the  corresponding  value 
of  s  such  that 


TT 

f 

y 


(9)  d0 


+  o 


0 


(Eq.  5-13) 


via 


00 


(Eq.  5-14) 


Numerical  Example 

The  identification  procedure  will  now  be  illustrated  with  a  numeri¬ 
cal  example.  Assume  that  Fourier  analysis  has  been  used  to  identify  the 
following  sinusoidal  plus  white  noise  model;  this  example  is  adapted 

from  O'Connor  and  Kapoor  (1982). 

Given: 

A  =  8.643 
2rr 

w  =  24 

a2  =  8.460  (e9-  5~15> 

a 

N  =  240 


The  deterministic  spectrum  is 


f  (0) 
x 


1,429.4 


2.693 


for  9  =  j  =  0,  1,  ...  ,120 

2 

and  o2  =  --  +  n2  --  43.811 
x  2  a 


(Eq.  5*16) 


Therefore  the  frequency  decomposition  of  the  variance  of  xt ,  obtained  by 
Integrating  fx(9)  via  the  rectangular  rule,  is 
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Var (x  ) |  -  t  £*<»>- 

e±» 


i  iZL 

Let  X  =  .999  e  24  (Eq.  5-18) 

1  2rr 

and  calculate  v  =  s  e  24  such  that 

OO  2 

al  I  -  4-  +  a\  =  45.811  (Eq.  5-19) 

a  j-0  J  2  3 


A_ 

2 

2o2 

a 

l  N 


2o 


37.421 


.0705 


(Eq.  5-17) 


0^0) 


i.e. 


i0Gj  ‘  T  '  \  *  1  '  5-415 

j=0  J  a 


(Eq.  5-20) 


An  iterative  solution  of  Eq.  4-26  gives  s 

Thus 


.9308  when  ^QG2  -  5.415. 


X 


0.999 


v 


0.9308 


(Eq.  5-21) 


and  therefore 

4>i  .  X  +  X  -  1.9299  b1  -  V  +  v  -  1.7982 

<j>2  •  -XX  -  -0.9980  02  *  -vv  -  -0.8664  (Eq.  5-22) 

00  i 

a2  -  o2  I  G.  ■  45.811 

i  a  jio  3 
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Comparing 


|eiw  _  v| 


1  -  s  -  .069 


to 


|ei(w  +  tt/N)  _eiui|  =  2  sin  —  =  .013 
1  '  2N 


(Eq.  5-23) 


(Eq.  5-24) 


shows  that  v  is  not  much  closer  to  than  the  distance  between  e^  and 
el(to  +  n/N).  The  effect  of  this  can  be  seen  in  Table  1,  which  shows  a 


portion  of  fy(6)  and  the 


8+2 


e  -  2 

N 


N  f  (8)d0.  The  variance  of  y  around 

it  y  t 


(J  f  (<*>),  is  36.661  vs  _  fx  (to)  *  37.421.  Also  the  variance  of  y  in 

’  y  ’  N  *• 

the  intervals  on  either  side  of  to  is  large  compared  to  the  desired 

2rr 

N 


fx  (w  +  2tt/N)  -  .0705  while  the  variance  at  high  frequencies  is  low. 


The  deterministic  model  has  a  total  variance,  *  45.811,  distributed 

such  that  the  variance  of  at  to  is  37.421  and  the  remaining  variance 

of  8.390  is  distributed  evenly  at  the  remaining  frequencies.  This  sto- 

2 

chastic  model  results  in  a  total  variance,  o  “  45.811,  but  the  variance 

y 

of  yt  at  w  is  36.661,  which  is  80.0%  of  the  total  variance  versus  the 

2 

desired  81.7%.  Also  the  variance  of  y.  at  to  +  is  about  .68 »  °r 

c  ~  N 

almost  10  times  the  desired  variance.  Therefore,  this  stochastic  model 
is  not  exactly  equivalent  to  the  given  deterministic  model. 


We  can  improve  the  approximation  by  moving  both  X  and  v  closer  to 

2v_ 

the  unit  circle.  When  X  ■  .99999  e  24,  we  find  v  ■  .9933  e  24.  Hence 
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<t>i  =  1.93183 
4,2  -  -0.99998 

61  =  1.91895  (Eq.  5-25) 

02  =  -0.98669 

o2  =  45.811 

y 

In  this  case  v  is  close  to  eiw,  .007,  compared  to  the  distance 

between  e^w  and  e^(w  i  .013.  Table  2  also  shows  that  the  distri¬ 

bution  of  the  variance  of  y  is  very  close  to  the  desired  variance  dis¬ 
tribution  of  x^.  The  variance  of  y^  at  w,  37.515,  is  81.9%  of  the  total 
variance  versus  the  desired  variance  of  37.421  or  81.7%,  and  the 
remainder  of  the  variance  is  quite  evenly  distributed. 

A  stochastic  model  which  represents  the  same  frequency  decomposi¬ 
tion  of  variance,  to  any  arbitrary  approximation,  can  be  found  for  any 
real  valued  sinusoid  plus  white  noise.  The  required  degree  of  approxi¬ 
mation  depends  on  the  application. 

The  identification  of  an  equivalent,  or  approximately  equivalent, 
deterministic  model  for  a  given  stochastic  model  relies  on  the  same 
principles  illustrated  in  the  above  example.  The  "goodness"  of  the 
approximation  is  evaluated  by  considering  the  frequency  decomposition  of 
variance. 

For  example,  suppose  we  have  identified  as  the  best  stochastic 
model  for  a  given  time  series  the  ARMA(2,2)  whose  spectrum  is  shown  in 
Table  1.  The  concentration  of  the  variance  of  y  in  the  interval 
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Table  5-2.  Stochastic  Spectrum:  r*. 99999,  S-.9933 


j 

CD 

II 

f  (9) 

y 

jfy(e)de 

0 

0.000 

2.661 

.0348 

1 

.026 

2.661 

.0697 

2 

.052 

2.661 

.0697 

3 

.079 

2.662 

.0697 

4 

.105 

2.663 

.0697 

5 

.131 

2.665 

.0698 

6 

.157 

2.669 

.0699 

7 

.183 

2.677 

.0701 

8 

.209 

2.701 

.0708 

9 

.236 

2.832 

.0757 

10 

.26  2 

1192486.736 

37.5145 

11 

.288 

2.832 

.0756 

12 

.314 

2.701 

.0708 

13 

.340 

2.677 

.0701 

14 

.367 

2.668 

.0699 

15 

.393 

2.664 

.0698 

16 

.419 

2.662 

.0697 

17 

.445 

2.661 

.0697 

18 

.471 

2.660 

.0696 

19 

.497 

2.659 

.0696 

20 

.524 

2.659 

.0696 

21 

.550 

2.659 

.0696 

22 

.576 

2.659 

.0696 

23 

.602 

2.658 

.0696 

24 

.628 

2.658 

.0696 

25 

.654 

2.658 

.0696 

26 

.681 

2.658 

.0696 

27 

.707 

2.658 

.0696 

28 

.733 

2.658 

.0696 

29 

.759 

2.658 

.0696 

30 

• 

.785 

• 

2.658 

• 

.0696 

• 

1 19 

• 

3.115 

• 

2.657 

■ 

• 

.0696 

120 

3.142 

2.657 

.0348 
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,2tt  it  2 7T  ir  . 

(. —  -  -  —  +  - )  suggests  the  presence  of  a  sinusoid  whose  period 

24  240  24  240 

is  24.  A  hypothesis  test  of  the  "goodness"  of  modeling  this  time  series 
as  a  sinusoid  plus  white  noise  can  be  based  on  the  difference  in  the  sum 
of  the  squared  errors  explained  by  the  stochastic  and  deterministic 
models  and  the  degree  to  which  the  residual  series  of  the  deterministic 
model  departs  from  the  white  noise  assumption. 

This  type  of  analysis  provides  the  basis  for  determining  the  signi¬ 
ficance  of  pole-zero  pairs.  The  significance  of  cancelling  nearly  equal 
poles  and  zeros  or  modeling  their  effect  with  a  sinusoid  can  be  deter¬ 
mined  through  an  analysis  of  variance. 

This  chapter  has  illustrated  numerically  the  procedure  for  identi¬ 
fying  equivalent  deterministic  and  stochastic  models  for  time  series 
with  a  periodic  component.  We  have  shown  that  the  significance  of 
departures  from  exact  equivalence  for  approximately  equivalent  deter¬ 
ministic  and  stochastic  models  can  be  evaluated  by  comparing  the  fre¬ 
quency  decomposition  of  variance  implied  by  each  model. 


A3 


6.  SUMMARY  AND  CONCLUSIONS 


Summary 


The  concept  of  equivalency  between  a  second  order  stationary  sto¬ 
chastic  and  deterministic  representation  of  a  periodic  component  in  a 
time  series  was  developed  in  Chapter  A.  A  deterministic  and  stochastic 
model  are  equivalent  when  they  represent  the  same  frequency  decomposi¬ 
tion  of  variance.  Equivalence  of  the  spectral  representations  requires 
integration  of  the  continuous  form  of  the  stochastic  spectrum  over  each 

of  the  ^  intervals  of  length  to  make  the  stochastic  spectrum  directly 
comparable  to  the  discrete  spectrum  of  the  deterministic  representation. 


A  procedure  for  finding  an  equivalent  stochastic  representation  for 
a  given  deterministic  representation  that  uses  the  graphical  interpreta¬ 


tion  of  the  stochastic 


oo 

spectrum  and  the  analytic  expression  for  £g.  to 

j-0J 


calculate  the  integral  of  the  stochastic  spectrum  was  also  developed  in 
Chapter  A  and  illustrated  in  Chapter  5.  This  procedure  consists  of:  1) 
choosing  the  poles  and  zeros  of  the  stochastic  model  such  that  the  spec- 
trum  has  a  peak  at  the  same  frequency  as  the  deterministic  sinusoid  and 
such  that  the  total  variance  of  the  output  of  the  stochastic  process  is 
equal  to  the  total  variance  of  the  sinusoid  plus  white  noise  determinis¬ 
tic  model;  and  2)  comparing  the  frequency  decomposition  of  the  variance 
of  the  stochastic  model  to  that  of  the  deterministic  model  for  each 
discrete  frequency  interval. 
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Important  implications  of  these  results  are  as  follows.  The  iden¬ 
tification  of  mathematical  equivalence,  when  it  exists,  allows  the  time 
series  analyst  to  choose  between  potentially  equivalent  deterministic 
and  stochastic  representations.  Both  representations  reflect  the  same 
information  contained  in  the  available  realization  of  and  are 

mathematically  equivalent  second  order  stationary  models.  Hence,  there 
are  no  grounds,  based  on  {xt},  to  argue  for  one  representation  versus 
its  equivalent  alternative.  The  choice  must  be  based  on  considerations 
of  the  process  itself  (e.g.,  physical  arguments)  or  on  other  information 
beyond  that  contained  in  {x  }.  This  result  provides  a  basis  for  identi¬ 
fying  the  similarities  and  differences  among  alternative  time  series 
models. 

The  concept  of  equivalence  can  also  be  used  to  evaluate  models 
whose  spectral  representations,  while  not  exactly  equivalent,  are 
approximately  equivalent.  Although  any  real  valued  sinusoid  can  be 
represented  by  an  equivalent  stochastic  model,  not  all  stochastic 
processes  can  be  represented  exactly  by  a  single  real  valued  sinusoid. 
The  significance  of  the  departure  from  exact  equivalence  can  be 
evaluated  by  comparing  the  frequency  decomposition  of  variance  implied 
by  each  model . 

These  two  concepts  provide  a  way  to  identify  deterministic 
sinusoids  by  using  stochastic  modeling  techniques.  This  may  prove  par¬ 
ticularly  useful  for  time  series  which  unexpectedly  contain  sinusoidal 
behavior  or  which  contain  sinusoids  of  unknown  frequency.  Conversely, 
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deterministic  structure  can  be  identified  using  Fourier  spectral  tech¬ 
niques  and  the  results  transformed  to  their  stochastic  equivalent. 

This  analysis  also  provides  some  insight  into  the  role  of  pole-zero 
pairs  in  stochastic  models.  For  example,  it  has  been  shown  that  pole- 
zero  pairs  near  the  unit  circle  are  not  necessarily  indicative  of  over¬ 
fitting,  i.e.,  they  do  not  necessarily  cancel.  These  results  provide 
criteria  for  determining  when  pole-zero  pairs  can  be  cancelled  based  on 
the  variance  associated  with  the  pole-zero  pair.  If  the  associated 
variance  is  large,  then  the  poles  and  zeros  cannot  be  cancelled.  If  the 
variance  is  small,  then  the  poles  and  zeros  may  be  cancelled  depending 
on  the  purpose  of  the  model  —  characterization,  forecasting,  or  control 
—  and  the  understanding  of  the  underlying  process  dynamics. 

This  insight  looks  promising  for  explaining  several  empirical 
observations,  such  as:  the  general  requirement  for  a  seasonal  moving 
average  term  when  seasonal  differencing  is  used;  the  ability  of  AR(2) 
models  to  represent  a  sinusoidal  determinism;  and  the  ability  of 
ARMA(2,1),  ARMA(4 ,3) , . . . ,ARMA(2n,2n-l)  models  with  pole-zero  pairs  near 
the  unit  circle  to  represent  a  sum  of  sinusoids  plus  a  stochastic-only 
random  element. 

Conclusions 


The  following  conclusions  are  drawn  from  this  research: 
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1.  Under  the  assumption  of  integer  multiples  of  periodicity,  the 
spectrum  of  a  deterministic  time  series  was  shown,  Chapter  2,  to  be  par¬ 
ticularly  simple. 

2.  The  graphical  interpretation,  presented  in  Chapter  3,  of  the 
poles  and  zeros  in  the  unit  circle  of  the  complex  plane  provides  useful 
insight  to  the  stochastic  spectrum. 

oo 

v  2 

3.  The  analytic  expression  for  l  G,,  derived  in  Appendix  C,  is 

j=0  J 

helpful  for  identifying  equivalent  deterministic  and  stochastic  models. 

4.  Spectrally  equivalent  deterministic  and  stochastic  models  can 
be  identified  through  the  identification  procedure  developed  in  Chapter 
4  and  illustrated  in  Chapter  5. 

5.  This  research  has  identified  the  need  for  future  work  as  fol¬ 
lows  : 


i.  The  equivalency  of  the  spectral  representations  in  the  fre¬ 
quency  domain  should  be  transformed  to  the  time  domain  and  interpreted 
in  terms  of  the  autocovariance  function. 

ii.  The  procedures  for  identifying  an  equivalent  stochastic 
representation  for  a  given  deterministic  representation  should  be 
extended  to  address  a  sum  of  sinusoids  plus  a  stochastic  only  random 


element,  i.e., 
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M 

J  Aj  cos(aijt  +  u0j)  +  ii)(B)at  -  ^'(B)at  (Etl*  6-1) 


111.  The  procedures  advocated  by  the  three  most  commonly  used  time 
series  modeling  approaches  —  Box-Jenklns,  DDS,  and  deterministic  plus 
stochastic  —  should  be  examined  and  Interpreted  In  the  light  of  the 
above  extensions. 
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APPENDIX  A.  SPECTRUM  OF  A  SINUSOID 


If 


d  =  A  cos  (cot  +  (o  ) 
t  o 


t  =  1,2 . N 


then,  by  definition,  the  spectrum,  f  ,(0)  is 

d 


fd(0)  "  ^ 


i  dte 

t=i 


iOt 


0  <  0  <  7T 


ttN 


N  -  H  , 

(  £  d  cos  8t)  +  (  £  d  sin  0t) 

t=l  C  t=l  1 


JT 

ttN 


(  £  cos  (CUt  +  0)  )  cos  0t)‘ 


L  t-l 


+  (  £  cos  (cut  +  cu  )  sin  0t)‘ 


t=l 


The  terms  in  each  summation  can  be  rewritten  as 


cos  (cut  +  cuq)  cos  8t  =  — 


cos  ((cu  +  0)  t  +  cu  ) 
o 


+  cos  ( (cu  -  0)  t  +  <u  ) 
o 


and 


cos  (cut  +  cu  )  sin  0t  =  "7 
o  2 


sin  ((cu  +  0)t  +  cu  ) 
o 


-  sin  ((cu  -  8) t  +  cu  ) 
o 


(Eq.  A-l) 


(Eq .  A-2) 


(Eq.  A-3) 


(Eq.  A-4) 


I 

i 
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Also 


N  4  — 

l  cob  (at  +  6)  -  COB  (-2Lp?  +  fi  ) 


t-1 


sin  j 


which  can  be  shown  as  follows 


N 

l  cos 
t-1 


N 


(at  +  B)  -  i  l 


t-1  L 


i(at  +  B>  ,  -i(at 
e  +  e 


+  B)  j 


N 


N 


1  IB  p  iat  .  1  -IB  r 
j  e  I  e  +  j  e  L 


-iat 


t-1 


t-1 


1 

2 


. n  ia,,  iNa.  ,Q  -ia  -iNa. 

iB  e  (1  -  e  )  .  -iB  e  (1  -  e  ) 
e  _ - - - <-  +  e  -ia 

1  -  e  1  -  e 


1 

2 


^(a+B)  eiNa/2(e-iNa/2_eiNa/2) 


iia/2^-ia/2_eia/2 


) 


.  -iNa/2  f  iNa/2  -iNa/2-, 

+  e  ,  le  ~e  ,  2 

-ia/2  r  ia/2  -ia/2-, 
e  (e  -e  J 


Dividing  both  numerator  and  denominator  by  2i  and  collecting 
yields 

±  (IfittlS+p]  »l°f  +  e-i  +  B  )  ^±3 


m 


sin  | 


.  « 

sin  j 


(Eq.  A-5) 


(Eq.  A-6) 


terms 


(Eq.  A-7) 
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Finally 


N 

J  cos  (at  +  3) 

t-1 


A  similar  derivation  gives 


N 

£  sin  (at  +  8)  -  sin 
t-1 


(^a+6) 


Na 
sin  ~2 
— 

sin  j 


(Eq. 


(Eq. 


Now  the  first  term  in  Eq.  A-2  though  the  use  of  Eq.  A-3  and  A- 5 
can  be  rewritten  as 

n  a  N  r  i 

£  A  cos  (cot-ko  )  cos  0t  *  -r  £  cos  (art-8)t+0) 

t-i  °  1  t-i  L  °J 


n  r  l 

\  cos  (a)~8)t+aj 
t-l  L 


A 

—  cos 


(N+l)  (cof8) 

2  o 


N(art-6) 
sin  2 


sin 


a>*0 


sin 


N(cu-9) 


.  A  J"  (N+l)  (a>-0)  .  1  2 

+  -  cos  - ST - ~  +  CD.  ! 


I' 


°J  .in  2^ 


Similarly  the  second  term  is 


N  a  N  f  1 

V  A  cos  (cot+co  )  sin0t-  -r  J  sin  (art-0)  t-ho 

t-i  °  2  t-i  L  °J 


(Eq. 


A 

2 


N 

y 

t-i 


sin 


(a>-0)  t+0) 

o 


A-8) 


A-9) 


A- 10) 
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N(0H3) 

f  -  [aapsu..  7^- 


•InS&ei 


-j  sln  miiszS!  +  „ I  “"-7 

l  2  o  (u-9 

*-  J  sin  — t— 


(Eq.  A 


Let 


c+  .  cos  [SBLMS*)  +  «J  s+ .  sin  r 


Owl )j6»e}  + 


2 


(0 


C  “  COS  1-=^- — %-*—■  '  +  (0  s 

i  o 


•In 

2  o 


N(oH-8) 

U  „  sin  2 
+  .  co+e 

sin  — 2“ 


(Eq.  A 


N(<o-6) 
sin  2 


sin 


<0-0 


Now  Eq.  A-2  can  be  written,  from  Eq.  A- 10,  11,  and  12,  as 
2 

£d(e)  -  ^  T  [(V+  *  c-k->2  +  <SA  '  8-k-)2  ] 


•m  [<<v  +  »X  +  2(v=- 


-  s+s_)k+k_  +  (c_  +  s 


X] 


(Eq. 


but 


2  2 
c+  +  s+  - 


-ID 


-12) 


A-13) 


1 


(Eq.  A- 14) 
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APPENDIX  B:  SPECTRUM  OF  WHITE  NOISE 


If  is  an  independently  and  identically  distributed  random  variable 

2 

of  mean  0  and  variance  a  then  the  spectrum  of  a  ,  denoted  by  f  (6), 

fl  C  A 


f  (0)  -  -f 

a  it 


o  <  e  <  tt 


Proof 


f  (0) 
a 


N 

I  v 

t-i  c 


*  ['i  ■•••••  >  <  j,  >] 


(Eq.  B-l) 


lL 


4  n  w 


i9(t-k) 


(Eq.  B-2) 


let  l  ■  t-k,  therefore  k  ■  t-2.  and 


fa(9)  '  is  |  |  Vt-I )  e> 


(Eq.  B-3) 


but  by  hypothesis 


t  Vt-*  “  0  1  *  0 


Hence 


£a<6>  ’  S  l,  \ 


(Eq.  B-4) 


f  (0)  -  -f 

a  tt 


(Eq.  B-5) 
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APPENDIX  C:  GREEN'S  FUNCTION 


Green' 8  function  is  defined  such  that 

X  -  l  G  a  (Eq.  C-l) 

c  j«o  3  3 

Therefore  an  ARMA(2,2)  model  can  be  written  as 
<KB)Xt  =  e(B)at 
(l-4>1B-(|>2E2)Xt  -  (l-61B-02B2)at 

a-4>lB-<J)2B2)a+G1B4G2B2+...)at  -  (l-BjB-e^2^  (Eq.  C-2) 

Equating  like  powers  of  B  gives  an  implicit  (recursive)  form  of 
Green's  function. 


g2  ■  hGi  '  h  " 
g3  -  4>xg2  -  $2g1 


:  G  =  1 

o 

:  G1  *  *1  ~  61 
:  G2  *  ^1G1  +  ^2  ~  62 
:  G3  “  ^lG2  +  ^2G1 


Gj  “  *lGj-l  ‘  ♦ 


2°j-2 


♦*-!  + 


*2Gj-2 


(Eq.  C-3) 


for  j  ■  3,4, .. . 
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Green's  function  can  also  be  written  in  an  explicit  (analytic)  form 
by  using  the  implicit  form  as  the  initial  conditions  and  the  general 
solution  to  a  second  order  difference  equation.  Assuming  distinct  roots 


Gj  "  glXl  +  g2X2  J  "  (Eq.  C-4) 

Therefore 

G1  "  glXl  +  g2X2  "  ^i  ”  ei  (Eq.  C-5) 


and 

G2  "  glXl  +  g2X2  “  ’  ^261  +  <t>2  "  02  (Eq*  C"6) 

-  (\L  +  \2)2  -  (X1  +  X^  +  (-X^)-  02 


From  Eq.  C-5 


♦i  -  9i  -  gixi 


Substituting  Eq.  07  into  Eq.  0-6  gives 


.2  .  *1  “  61  "  81X1  ,2  .2  .  „  .  . 

1  +  \  ^2  “  —  ®2 


gx(X2  -  X1X2)  -  $2  -  $1<S1  +  *2  -  02  -  $jX2  +  0xx2 


(Eq.  07) 


(Eq.  08) 


(Eq.  09) 
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O  ry 

^1  +  ^1^2  +  ^2  ~  ~  ^2^1  ~  ^1^2  “  ®2  “  ”  ^2  +  9  A, 

A^(A^  ~  A2) 


X1(X1  ~  91)  "  6 2 
A^(A^  ”  X2^ 


(Eq.  C-10) 


Substituting  Eq.  C-10  into  Eq.  c-7  gives 


,  ,  ,  „  X1(X1  -  V  -  62 

„  .  xi  +  x2  ei - rrr - 

o  2  ______ _ i _ Z _ 


<*!  +  X2HX2  ~  V’VW  +  WV  “  0; 


A2(A2  -  xx) 


X1X2  X2  —  X1  —  XiX2  —  0^X2  0^A^  —  A^0^  —  0 2 

X2  (A 2  ~  A^) 


x2 (x2  *  0^)  02 
x2(x2  -  A^) 


(Eq.  C-ll) 


Now  Gq  must  equal  one  so  consider 


81  +  82 


xi<xi  -  e1)  -  e2 
XjUj  -  x2) 


^2  (^2  ”  "™  ^2 

^2(^2  ""  A^) 


L. 


k 
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X^X2  ~  ~  ^2^2  ~  ^1^2  A1A201  "*"  ^1^2 


X1X2(X1  -  x2) 


X1X2  +  6 
A1A2 


2 


gl  +  g2 


(Eq. 


In  summary,  then,  the  explicit  form  of  Green's  function  is 


G 


0 


+  Sr 


=*  1 


G. 

J 


gl  A1  +  g2  A2 


1,2,. 


(Eq. 


where 


A1(A1  '  01}  "  02 
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The  explicit  form  of  Green's  function  can  also  be  written  in  a 
trigonometric  form  if  X  and  v  are  complex  conjugates. 
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Let 
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per  Figure  c-1. 
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Therefore, 
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Finally 
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We  now  derive  an  expression  for 
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Consider  the  first  term  of  Eq.  C-21 
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Similarly  the  third  term  is 
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Next,  the  second  term  is 
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(Eq.  C-24) 
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Thus,  Eq.  C-21  can  be  written  as 
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